Fractional quantum Hall effect in topological insulators: The role 

of Zeeman effect 

Zhigang Wang, 1 Fawei Zheng, 1 Zhen-Guo Fu, 2 and Ping Zhang 1, 2, Q 

1 LCP, Institute of Applied Physics and Computational Mathematics, 
P. 0. Box 8009, Beijing 100088, China 
2 Beijing Computational Science Research Center, Beijing 100089, China 

Abstract 

We study the role of Zeeman effect in fractional quantum Hall effect (FQHE) on the surface of 
topological insulators (TIs). We show that the effective pseudopotentials of the Coulomb inter- 
action are reformed due to Zeeman effect, which are quite different from those in graphene. By 
exactly diagonalizing the many-body Hamiltonian in the sphere geometry, we find that the ground 
state energies and the excitation gaps at v=l/3 FQHE between the n=±l Landau levels (LLs) 
render asymmetry, and the FQHE state at the n=l LL is more robust than that at n=— 1 LL since 
the excitation gap at n=l LL is larger than that at n=— 1 LL. 
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I. INTRODUCTION 



Because of the rich physical properties in fractional quantum Hall effect (FQHE), it has 
proved to be a vital and exciting subfield of condensed-matter physics to the present day. 
The electronic state giving rise to the experimentally l|-[5| observed FQHE features should 
be of a many-particle origin, and has been studied intensively with various theoretical tools 
6Ml6| . At present, most of experiments on this issue are performed in high-mobility GaAs- 
based semiconductor structures. However, it is a still a challenge to detect the fractional 
quantum Ha„ state with high uliiug facto,, Q (such as ,=5/2) due to the restrict of carrier 
mobility and the weak electron interactions in two dimensional semiconductor materials. 



Fortunately, recently discovered two-dimensiona 



18l ll9j. two-dimensional H gTe quantum wells 20|,|2l|, and surface state of three-dimensional 



electron systems, including graphene 



topological insulators (TI) 22|, |23|, which possess linear dispersion relation near the Dirac 
points with high Fermi velocity, may be good platforms to detect the FQHE. The unusual 
integer quantum Hall effect (IQHE) 24], |25] with the 4e 2 /h separation in the quantized Hall 
conductivity has been found experimentally in graphene, where the Landau levels (LLs) 
are four-fold degenerate without Zeeman effect and weak spin-orbit couplings. Soon after 
this discovery, Nomura and MacDonald 26| suggested the interaction-driven quantum Hall 
effects with intermediate integer value of e 2 / h because of the charge gaps due to the electron- 



27 



29|, and the 



electron interaction. FQHE in graphene was also predicted theoretically 

1/3-FQHE state was later measured [30|, |3jJ successfully in suspended graphene. 

Because of the Dirac nature of the electrons, many properties of the two-dimensional and 

three-dimensional TIs are similar to those of graphene. Recently, the graphene-like IQHE 

I I 

has been observed in strained bulk HgTe [32| and the LL spectrum has been measured in 



Bi 2 Se3 by using scanning tunneling microscopy 



33 



34j . Features in the Hall resistance at 



fractional filling factors have been speculated to be related to the FQHE of TIs 



35 



36]. 



However, the finite thickness of TI sample in the growth direction will affect the nature 

r i 

of the FQHE states on TI surfaces [37j, which is in contrast to the case in graphene. In addi- 
tion, there exists an another remarkable difference between graphene and TI, among which 
topologically protected Dirac cones on the surface of three-dimensional TI arise from the 
real spin-orbit coupling while the Dirac cone in graphene results from the pseudospin-orbit 
coupling. As a consequence, the external magnetic field induced Zeeman effect in TI and 



2 



graphene are quite different. The Zeeman effect reforms the LLs as sgn(n) y A^+|n| (fku) 2 
in TI (Az is the Zeeman energy, n is the LL index and u=eB /mc is the cyclotron fre- 
quency), while in graphene the LLs split as ±^^/\n\hu±Az in the presence of Zeeman effect. 
Thereby, the influence of Zeeman effect on FQHE in TI should be quite different from that in 
graphene. Furthermore, on one side, the Zeeman term can perturb the Landau quantization 
in TI materials for a sufficiently large g-factor, which can reach ~30 in recent experiment 



performed on the surface of Bi 2 Se 3 



351 ] . in contrast, the g-factor in graphene is very small. 



On the other side, sufficiently strong magnetic field as large as hundreds of tesla, which can 
also bring on prominent Zeeman effect, is achievable in current experimental capabilities. 

Therefore, because of its importance both from basic point of interest and to the analysis 
of unconventional properties of Tl-based FQHE, in the present paper we address the role 
of Zeeman effect in FQHE of the massless Dirac electrons on TI surface by presenting an 
attempt at the theoretical evaluation of the effective pseudopotentials of the electron-electron 
interactions and the ground (excitation) state nature at 1/3-FQHE between the n=±l LLs 
problems. We find the following facts: (i) The effective pseudopotentials of the Coulomb 
interaction vjg '"^ (m is the relative angular momentum of two electrons) are reformed due to 
the Zeeman term. At the first few relative angular momentum m, we have V^ n ' ,m ^>V^g ' n ' ,m ' ) 
for any LL n^O, while by increasing m to a moderate value, an inverse of the effective 
pseudopotentials happens V^[ n '' m ^ <V^' n ' ,m ' 1 . (ii) By taking into account the Zeeman effect 
and exactly diagonalizing the many-body Hamiltonian in the sphere geometry, the ground 
state energies and the excitation gaps at z/=l/3 FQHE between the n=±l LLs exhibit 
asymmetry, (iii) Comparing with that at the n=—l LL, the FQHE state at the n=l LL is 
more robust because the excitation gap at n=l LL is larger than that in n=— 1 LL in the 
presence of the Zeeman energy. These findings obtained can not be observed in graphene 
within Zeeman effect, because the Zeeman energies in graphene just translate the LLs by 
±gfi B B, but induce no influence on the the Haldane's pseudopotential of electron-electron 
interactions. 
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II. MODEL AND METHOD 



We start from the free electron low-energy effective Hamiltonian of TI surface in the 
presence of a perpendicular magnetic field, which is given by 

H = v F cr 11 + gfi B Ba z , (1) 

where Vp is the Fermi velocity and Tl—p+eA/c is the two-dimensional canonical mo- 
mentum. It is easy to obtain the eigenstates of Eq. ([I]), by choosing symmetric gauge 
A=B (— y/2, x/2, 0) and introducing the ladder operators flt= ^ 2Z<9 Z ), a—A^ ^+2ld g ), 



as 



*».m(r) = I an0 ' nhl,m I , (2) 

Pn<f>\n\,m 

where cj) nm is the eigenstate of the 2D Hamiltonian with non-relativistic quadratic disper- 
sion relation in nth LL with angular momentum m. Here, z=x+iy, and the magnetic length 
l=^eB/hc, which is the length unit throughout this paper. a n =— isgn(n) 



COS ip n 



Al /2(l-sgn(n) sin tp n ) 



and P n =\l ' — s g n (") sm ^") f or n^O, while a n =0 and /3 n =l for n=0 LL, which contain the 



information of Zeeman effect since Lp n =g[isB j '(hvpl 1 ^y2\n\)=(p/ ^2\n\. The correspond- 



ing eigenenergies are given by E n ^ =sgn(n)y (gfi B B) +2\n\h 2 v 2 F l~ 2 , and E n=0 =—gfi B B, 
which are different from LLs in graphene E^ ra, =±gn B B±^y2\n\hvFl^ 1 taken into account 
the Zeeman splitting in the effective Hamiltonian at the Dirac point K (or K') of graphene 
HQ Ta =VF(T-II®l2x2+hx2^>gf J 'BB-s with cr the pseudospin and s the real spin. 

In order to investigate the properties of TI surface FQHE at partially occupied LLs 
with fractional filling factors, we should firstly consider Coulomb interaction V(r)=e 2 /er 
between two electrons in nth LL with relative angular momentum m. It is expressed as the 
Haldane's pseudopotential 



y(^ m ) = ^ (j irril ■ nm2 1 1 V 1 1 nm3 ; nm^) ) 

y(\n\-l) , COB "'Pn v (\ n \,\ n \-i) 

I'm * m 



4 2 

COS (p n - 

4 (1— sgn(n) sin ip n ) 2 m - 

\2 



| (l-sgn(n)sin^ w; ^ (|n|) ^ 
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FIG. 1: (Color online) The effective pseudopotentials of the Coulomb interaction V^ ff ' between 
two electrons at n=±l LLs with the lowest four relative angular momentum m as a function of 
Zeeman parameter ip=gfiBB /HvfI 1 ■ The solid and dotted lines correspond to n=l and n=— 1 
LLs, respectively. 

where \\nmi; nmi)) =t„ imi ®? n|ma and 

x L|„,_, (i 2 /2) L,„ (i 2 ) e"* 2 , (5) 

with L m (x) the Lagueree polynomials. In what follows, the energy unit is chosen as e c =e 2 /el, 
and focus on the role of Zeeman effect in TI surface FQHE. It is clear that the Zeeman term 
can perturb the Landau quantization itself for a sufficiently large g-factor or a sufficiently 
strong external magnetic field B. 
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III. RESULTS AND DISCUSSIONS 



One can easily find from Eq. (J3]) that the effective pseudo-potential at the n=0 LL is 
independent on the Zeeman energy. The effective pseudopotentials at other LLs (n^O), 
however, are dependent on the Zeeman energy. Because the stability of FQHE phenomenon 
can only occur at n=0, ±1 LLs on a TI surface 38j, we only plot in Fig. [1] the effective 
pseudopotentials of the Coulomb interaction between two electrons at n=±l LLs with 

the lowest four relative angular momentum m=0, • • •, 3 as a function of Zeeman parameter 
(p. We notice that on one side, the pseudopotentials V^ m ^ and v}^ 1 '™' are degenerate in the 
absence of Zeeman term (ip=0), which could also be straightforwardly observed from Eq. (J3]) 
by setting ip n =0. On the other side, the degeneracy between and V^ ,m " > is removed 

with increasing the Zeeman parameter (p. Interestingly, one can see in Fig. [1] that under 
the same Zeeman parameter (p (for example, <p=0.2) the splitting of pseudopotentials for 



relative angular momentum m—1, i.e. 



v eff v eff 



is smaller than that for other lower 



relative angular momentum m=0,2,and 3. We also find in Fig. [I] that, for the electrons at 
LL n=±l the pseudopotentials V^^ 1 >V^ ,m ^ only for relative angular momentum m=0 
and 1, but V^fKV}^ 1 '"^ for higher angular momentum m. 

These results could also be seen from Fig. [2](a), where the red squares (blue triangles) 
correspond to n=l (n—— 1) with p=0.2. In fact, it is a truth that at the first few relative 
angular momentum m, we have V^ f j n ' ,m ' 1 >V^' n ' ,rr ^ for any LL nj^O, while by increasing m to 
a moderate value, an inverse of the effective pseudopotentials happens V^ 1 <v} s ' n ' ,w - ) . As 
an another example, we also show the pseudopotentials at LL n= ± 2 verse relative angular 
momentum m in Fig. Mjo). 

Based on the pseudopotentials for Dirac fermions on the surface of TIs, one can further 
obtain the energy spectra of the many-body states at fractional fillings of the LL by numer- 
ically diagonalizing the many-body Hamiltonian in the spherical geometry . In this point 
of view, thus the external magnetic field perpendicular to the surface of sample is equivalent 
to a fictitious radial magnetic field produced by a magnetic monopole at the center of sphere 
of radius R, which is related to the magnetic fluxes 2S through the sphere. It is easy to 
demonstrate that in the units of flux quanta R=\fSl 1 and the many-body states could be 
described by the total angular momentum L and its z component L z , while the energy just 
depends on L. In what follows, we investigate the system with the fractional filling factor 
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FIG. 2: (Color online) The effective pseudopotentials between two electrons at (a) n=±l and 

(b) n=±2 LLs as functions of the relative angular momentum m with different Zeeman parameters 
ip=0 and ip=0.2. The lines are a guide to the eye. 

v=\j (2p+l), where p is an integer, especially the p=l case, i.e., the z/=l/3 FQHE state 
which is realized at 5*=| (N— 1) in the spherical geometry, where iV is the electron number. 

The typical results of exactly diagonalized energy spectra per electron for the 
z/=l/3-FQHE state at n=±l LLs with the same Zeeman parameter if =0.2 as well as the 
degenerate energy spectra for the i/=l/3-FQHE state at n=±l without Zeeman term are 
shown in Fig. [3j One can clearly observe in Fig. [3] that the degenerate energy spectra (black) 
at ip=0 split into two-class alike energy spectra when the Zeeman term are introduced. The 
excited energy spectra (red) at n=l LL are promoted while those (blue) at n=—l LL are 
degraded. From Fig. [3] one can also find two prominent features brought by the Zeeman 
term as follows: (i) The FQHE state at the n=l LL is more robust since the excitation 
gap at n=l LL is larger than that at n=—l LL in the presence of the Zeeman term; (ii) 
However, the promotion (degradation) of each excited energy is not same with each other, 
which indicates that the Zeeman term leads to the asymmetry of the LLs. These two prop- 
erties of the Zeeman effect on the FQHE in TIs are unique, which can not be observed in 
the popular studied graphene system because the Zeeman energy in graphene Hamiltonian 
i7f ra does not affect the Haldane's pseudopotential but just translate the LLs by ±g//s-B. 

We now turn to study the dependence of the excited gap on the Zeeman parameter ip. In 
Fig. H]we show the excited energy gap (in unit of e c ) versus Zeeman parameter if for iV=6 
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FIG. 3: (Color online) Exact energy per electron versus the angular momentum L for N=6 electrons 
at u=l/3 FQHE state. The blue and red lines correspond to the n=l and n=— 1 LLs, respectively. 
The Zeeman parameter is chosen as tp=0.2. 
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FIG. 4: (Color online) Excited energy gap versus Zeeman parameter tp for iV=6 electrons at u=l/3 
FQHE state. The red and blue lines correspond to the n=l and n=— 1 LLs, respectively. 

electrons at 1/3-FQHE state, whose corresponding lowest excited state angular momentum 
is L=4. One can clearly see that the excited gap for n=l LL is always larger than that for 
n=-l LL, which is consistent with the results in Fig. [3J Besides, the excited gap for n=-l 
LL monotonically decreases with increasing the Zeeman parameter (see the blue line in Fig. 
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FIG. 5: (Color online) Excited energy gap versus the inverse of the electron number iV for the 
n=±l LLs with different Zeeman parameters ip=0.2 and (p=0. The integers denote the angular 
momentums L of the lowest excited energy states. 

H]). Whereas, the variance of the excited gap for n=l LL (the red line in Fig. H]) is weak 
with increasing the Zeeman parameter, and it gradually increases to a maximum at <£>^0.42 
and then tends to decrease. 

The above discussions focus on the system of N=6 electrons, but the properties obtained 
herein are conserved when the electron number N is changed. The results of the excited gap 
as a function of N are shown in Fig. [5j We should point out that, firstly, for the n=0 LL, the 
Zeeman term does not affect the FQHE in TIs and therefore the excited gaps are same for 
different values of (p. Secondly, the case of n=0 LL is quite different from that for n^O LLs. 
From Fig. |5]we see that the excited gap is promoted (degraded) for n=l (n=— 1) LL due to 
the Zeeman effect. Thirdly, the angular momentum L of lowest excited state alters with the 
electron number N, which is indicated by the integers in Fig. [5j For instance, the angular 
momentum of the lowest excited states for systems of N=4 and 5 electrons are L=3, while 
this becomes L=4 for systems of N=6 and 7 electrons. We also studied the FQHE with the 
fractional filling factor v—lj (2p + 1), where p—2, 3,- ■ ■ , and obtain the same results as that 
with u—1/3. 
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IV. SUMMARY 



In summary, we have studied the Zeeman effect on FQHE in TIs. Compared to previ- 
ously studied graphene system, the combination of the real spin-orbit interaction and the 
Zeeman term bring on unique physical properties in TIs. We have found that the effective 
pseudopotentials of the Coulomb interaction are reformed owing to the Zeeman effect. By 
exactly diagonalizing the many-body Hamiltonian in the sphere geometry, we also found 
that the ground state energies and the excitation gaps at z/=l/3 FQHE between the n=±l 
Landau levels (LLs) exhibit asymmetry. Comparing with the n——l LL, the FQHE state at 
the n—1 LL is more robust since its excitation gap is larger. We hope our predictions can 
be confirmed in future experiments. 
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90921003, No. 11274049, and No. 11004013, and by the National Basic Research Program 
of China (973 Program) under Grant No. 2009CB929103. 
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